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Abstract 

We  propose  new  techniques  for  the  solution  of  the  LP  relaxation  and  the  Lagrangean 
dual  in  combinatorial  optimization  problems.  Our  techniques  find  the  optimal  solution 
value  and  the  optimal  dual  multipliers  of  the  LP  relaxation  and  the  Lagrangean  dual 
in  polynomial  time  using  as  a  subroutine  either  the  Ellipsoid  algorithm  or  the  recent 
algorithm  of  Vaidya.  Moreover,  in  problems  of  a  certain  structure  our  techniques  find 
not  only  the  optimal  solution  value,  but  the  solution  as  well.  Our  techniques  lead  to 
significant  improvements  in  running  time  compared  with  previously  known  methods  (in¬ 
terior  point  methods,  Ellipsoid  algorithm,  Vaidya’s  algorithm).  We  apply  our  method 
to  the  solution  of  the  LP  relaxation  and  the  Lagrangean  dual  of  several  classical  com¬ 
binatorial  problems,  like  the  traveling  salesman  problem,  the  vehicle  routing  problem, 
the  Steiner  tree  problem,  the  ^-connected  problem,  multicommodity  flows,  network  de¬ 
sign  problems,  network  flow  problems  with  side  constraints,  facility  location  problems, 
/•f-polymatroid  intersection,  multiple  item  capacitated  lot  sizing  problem,  etc.  In  all 
these  applications  our  techniques  significantly  improve  the  running  time  and  yield  the 
fastest  way  to  solve  them. 

Key  words.  Lagrangean  relaxation,  linear  programming  relaxation,  polynomial  algo¬ 
rithm. 

‘Dimitris  Bertsimas,  Sloan  School  of  Management,  MIT. 
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1  Introduction 


During  the  last  two  decades  combinatorial  optimization  has  been  one  of  the  fastest  grow¬ 
ing  areas  in  mathematical  programming.  One  major  success  has  been  computational:  re¬ 
searchers  have  been  able  to  solve  large-scale  instances  of  some  NP-Hard  combinatorial  op¬ 
timization  problems.  The  successful  solution  approaches  typically  rely  on  solving,  either 
approximately  or  exactly,  the  linear  programming  (LP)  relaxation  or  the  Lagrangean  dual 
of  an  integer  programming  formulation  of  the  problem. 

The  successes  in  using  linear  programming  methodology  (LP  relaxations,  polyhedral 
combinatorics)  have  been  very  impressive.  Starting  with  the  seminal  computational  research 
conducted  by  Crowder  and  Padberg  [8]  and  Padberg  and  Hong  [26],  researchers  have  now 
been  able  to  solve  to  optimality  a  number  of  applications  including  traveling  salesman 
problems  with  up  to  2000  nodes  (Padberg  and  Rinaldi  [27]),  a  variety  of  large  scale  (up 
to  about  2000  integer  variables)  real  world  zero-one  business  planning  problems  (Crowder, 
Johnson  and  Padberg  [7]),  input-output  matrices  that  arise  in  economic  planning  (Grotschel, 
Jiinger  and  Reinelt  [14]),  multiple  item  capacitated  lot  size  problems  that  arise  in  production 
planning  (Barany,  Van  Roy  and  Wolsey  [5]  ,  Eppen  and  Martin  [10],  Leung,  Magnanti  and 
Vachani  [21]),  strategic  planning  problems  (Johnson,  Kostreva  and  Suhl  [19]),  production 
planning  problems  with  changeover  costs  (Magnanti  and  Vachani  [23]),  and  certain  spin 
glass  problems  that  arise  in  physics  (Barahona  et.  al.  [4]). 

These  successes  show  that  linear  programming  and  Lagrangean  relaxations  can  play  an 
important  role  in  solving  many  problems  met  in  practice.  The  landmark  in  the  development 
of  Lagrangian  relaxation  (see  for  example,  Geoffrion  [12]  or  Fisher  [11])  for  combinatorial 
optimization  problems  were  the  two  papers  for  the  traveling  salesman  problem  (TSP)  by 
Held  and  Karp  [16],  [17].  In  the  first  paper,  Held  and  Karp  [16]  proposed  a  Lagrangian 
relaxation  based  on  the  notion  of  1-tree  for  the  TSP.  Using  a  complete  characterization  of 
the  1-tree  polytope,  they  showed  that  this  Lagrangian  relaxation  gives  the  same  bound  as 
the  LP  relaxation  of  a  classical  formulation  of  the  TSP.  In  the  second  paper,  Held  and  Karp 
[17]  introduced  a  method,  which  is  now  known  under  the  name  of  subgradient  optimization 
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(see  also  Held,  Wolfe  and  Crowder  [18]),  to  solve  the  Lagrangian  dual.  Despite  its  success 
in  computational  experiments  subgradient  optimization  is  not  known  to  be  a  polynomial 
method. 

In  this  paper  we  propose  new  techniques  for  the  solution  of  the  LP  relaxation  and  the 
Lagrangean  dual  in  combinatorial  optimization  problems.  Our  techniques  find  the  optimal 
solution  value  and  the  optimal  dual  multipliers  of  the  LP  relaxation  and  the  Lagrangean  dual 
in  polynomial  time  using  as  a  subroutine  either  the  Ellipsoid  algorithm  [20]  or  the  recent 
algorithm  of  Vaidya  [29].  Moreover,  in  problems  of  a  certain  structure  our  techniques  find 
not  only  the  optimal  solution  value,  but  the  solution  as  well.  Suprisingly,  our  method  is 
significantly  faster  than  interior  point  methods  and  Ellipsoid  like  methods  directly  applied 
to  the  problem.  We  apply  our  techniques  to  the  solution  of  the  LP  relaxation  and  the 
Lagrangean  dual  of  several  classical  combinatorial  problems,  like  the  traveling  salesman 
problem,  the  vehicle  routing  problem,  the  Steiner  tree  problem,  the  ^-connected  problem, 
network  design  problems,  network  flow  problems  with  side  constraints,  facility  location 
problems,  if-polymatroid  intersection,  multiple  item  capacitated  lot  sizing  problem,  etc.  In 
all  these  applications  our  techniques  significantly  improve  the  running  time  and  yield  the 
fastest  way  to  solve  them.  Our  technique  can  also  be  used  to  speed  up  the  solution  of  the 
dual  of  multicommodity  flow  problems  in  certain  cases. 

The  paper  is  structured  as  follows:  In  section  2  we  introduce  our  method  and  its  vari¬ 
ations.  In  section  3  we  apply  it  to  a  wide  variety  of  classical  combinatorial  optimization 
problems.  The  final  section  contains  some  concluding  remarks. 

2  The  theoretical  development  of  new  techniques 

In  this  section  we  develop  the  algorithm  to  solve  linear  programming  problems.  The  method 
is  particularly  useful  for  problems  of  special  structure  as  those  appearing  in  the  solution  of 
LP  relaxations  of  combinatorial  optimization  problems. 
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2.1  An  algorithm  for  linear  programs  of  special  structure 
Consider  the  following  LP: 


(Pi)  z\  =  Min  cx  (1) 

subject  to 

Ax  =  b 
x  es, 


where  5  is  a  polyhedron.  Let  xk ,  k  €  J  be  the  extreme  points  of  S,  and  similarly  let  wk , 
k  €  R  be  the  extreme  rays  of  S.  Then  applying  the  resolution  theorem  for  the  polyhedron 
S  we  obtain  that  any  point  x  £  S  can  be  written  as: 


x  =  Y  *kxk  +  y  6k™k 

k£J  k£R 

A/c, # k  >o,  Y.\k  =  i. 

keJ 

Substituting  in  (1)  we  obtain  that  problem  (Pi)  is  equivalent  with 


(Pi)  Min  Z1  =  Y  Xk(cxk)  +  Y  9k(™k) 
keJ  keR 


subject  to 

Yh(Axk)+Ydk(Awk)  =  b 

keJ  keR 

EA*  =  i 

keJ 

^k,  6k  >  0. 


The  dual  of  the  above  problem  is 


(Z>i)  Z\  =  Max  yb  +  a 


subject  to 

y(Axk)  +  a  <  cxk ,  k  E  J, 
y(Awk)  <  cwk ,  keR. 
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Because  of  strong  duality,  problem  ( D\ )  has  exactly  the  same  value  as  the  original  problem 
(Pi).  Problem  (Pi),  however,  has  a  potentially  exponential  number  of  constraints.  In 
order  to  find  z  we  will  solve  problem  ( D\ )  using  either  the  ellipsoid  method  or  the  recent 
algorithm  of  Vaidya  [29]. 

Given  a  solution  yo,  op  for  the  dual  problem,  we  need  to  solve  the  separation  problem: 

(SEP)  u  =  Min  (c  —  yoA)x 

subject  to 

x  €  S. 

If  the  solution  of  this  problem  is  bounded  and  u  >  <r o  then  the  solution  (yo,  <To)  is  feasible 
in  (D\)  and  thus  we  can  start  Vaidya’s  sliding  objective  algorithm  (see  [29])  or  the  Sliding 
objective  Ellipsoid  algorithm  (see  for  example  Nemhauser  and  Wolsey  [25],  p.155)  with  the 
same  separation  problem.  If  u  <  op,  a  new  extreme  point  is  generated,  which  is  added  to 
( D\ ).  If,  on  the  other  hand,  the  subproblem  is  unbounded,  then  a  new  extreme  ray  of  S 
is  generated,  which  is  also  added  to  (Pi).  In  the  last  two  cases  the  ellipsoid  method  or 
Vaidya’s  algorithm  will  continue  with  one  extra  constraint.  The  algorithm  will  compute  the 
optimal  value  zj  of  (Pi)  (which  is  also  equal  to  the  optimal  value  of  (Pi)),  as  well  as  the 
optimal  dual  solution  y*  and  <r*. 

In  general,  Vaidya’s  [29]  algorithm  for  an  LP  with  k  variables  takes  O(kL)  iterations 
with  a  running  time 

0(TkL  +  M(k)kL),  (2) 

where  T  is  the  number  of  arithmetic  operations  to  solve  the  separation  problem  (SEP), 
L  is  the  input  size  of  problem  (Pi)  and  M(k)  is  the  number  of  arithmetic  operations  for 
multiplying  two  kxk  matrices.  (It  is  known  that  M(k )  =  0(k2'38)  [6]).  For  comparison,  the 
number  of  iterations  of  the  ellipsoid  algorithm  is  0(k2L)  and  its  running  time  is  0(Tk2L  + 
k4L).  Note  that  the  Ellipsoid  algorithm  does  not  benefit  from  fast  matrix  multiplication. 
So,  overall  Vaidya’s  algorithm  has  a  better  worst-case  time  complexity  than  the  ellipsoid 
method.  For  this  reason  we  will  use  Vaidya’s  algorithm  in  the  rest  of  the  paper. 
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For  problem  (Pi)  let  n  be  the  number  of  variables,  let  m  be  the  number  of  constraints 
Ax  =  b  and  let  T(n)  be  the  number  of  arithmetic  operations  to  solve  the  separation  problem 
(SEP).  Then,  the  number  of  variables  in  (Z?i)  is  it  =  m+1  and  thus  from  (2)  the  overall  time 
complexity  to  find  z\  and  the  optimal  dual  solution  y*,  a*  of  (£>i)  is  0(T(n)mL+ M(m)mL). 
We  summarize  the  previous  developments  in  the  following  theorem. 

Theorem  1  The  optimal  solution  value  z\  of  problem  (Pi)  and  the  optimal  dual  variables 
y* ,  cr*  can  be  found  in  0(T(n)mL  +  M(m)mL)  arithmetic  operations. 

A  natural  question  is  whether  we  can  also  find  the  optimal  primal  solution  x*  of  (Pi).  For 
example,  since  our  algorithm  takes  O(mL)  calls  to  the  separation  problem  (SEP),  there 
will  be  0(mL)  constraints  in  (Di)  and  correspondingly  0(mL)  variables  \k,6k  in  (P(). 
Applying  an  interior  point  algorithm  in  (P{)  we  can  find  the  optimal  A £,#£  in  0((mL)3L), 
from  which  we  can  compute  the  optimal  solution  x* .  Unfortunately,  this  running  time  is 
not  attractive  except  for  problems  where  L  =  0(1).  Moreover,  if  the  optimal  solutions  of 
problems  (Di),  (P()  are  unique  we  can  apply  the  complementary  slackness  property  and 
thus  we  can  find  the  optimal  x*  in  0(mL),  which  does  not  change  the  overall  complexity 
of  the  method.  In  applications,  however,  we  want  to  find  the  optimal  solution  value  rather 
than  the  solution  of  the  LP  or  the  Lagrangean  relaxation,  since  the  solution  value  can  be 
later  used  in  a  branch  and  bound  algorithm. 

2.2  LPs  with  more  than  one  subproblems 

We  now  generalize  the  technique  of  the  previous  subsection  to  handle  problems  of  the  form: 

(P2)  Z2  =  MinJ2r=l  cr*r  (3) 

subject  to 
N 

^2  Arxr  =  b 

r= 1 

Xr  ESr,  r  =  1,  .  . N 

where  each  Sr  is  a  polyhedron  with  the  property  that  optimizing  over  Sr  is  easy. 
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Let  xk,  k  E  Jr  be  the  extreme  points  of  Sr,  and  similarly  let  wk,  k  E  Rr  be  the  extreme 
rays  of  Sr ■  Using  the  same  technique  as  before  we  find  that  problem  (_P2)  is  equivalent  to 
problem  (£>2) 

N 


(D2)  z2  =  Max  yb  +  ')Tjo-T 


r=l 


subject  to 


y{Mx\)  +  a-i  <  C1X1,  k€Ji, 


y(A^x%)  +  crjv  <  CNXkN,  k  E  Jn, 
y(Aiwk)  <  cjtuf,  kERi, 


y(ApiwkN)  <  cNw^f,  k  E  Rn- 

In  order  to  apply  Vaidya’s  algorithm  to  (D2)  we  should  be  able  to  solve  efficiently  the 
separation  problem,  which  in  this  case  decomposes  to  the  N  subproblems: 


( SEPr )  Min  (cr  —  yAr)xr 

subject  to 

Xr  E  Sr- 

As  a  result,  Vaidya’s  algorithm  applied  to  (D2)  with  separation  problems  ( SEPr ),  r  = 
1, . . . ,  N  computes  the  optimal  value  z\  of  ( D2 )  (which  is  also  equal  to  the  optimal  solution 
value  of  (P2))  and  the  optimal  dual  solution  y*,  a*,r=l,...,N. 

Let  nr  be  the  number  of  variables  in  Sr ,  let  m  be  the  number  of  constraints  Arxr  = 
b  and  let  Tr(nT )  be  the  number  of  arithmetic  operations  to  solve  the  separation  problem 
( SEPr ).  Therefore,  the  total  number  of  arithmetic  operations  to  solve  the  entire  separation 
problem  is  Tr(nr).  Since  the  number  of  variables  in  ( D2 )  is  k  =  m  +  N,  we  obtain 

from  (2)  that  the  overall  time  complexity  to  solve  (D2)  is 

N 

0([  )](m  +  N)L  +  M(m  +  N)(m  +  N)L). 

r—1 
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Therefore 


Theorem  2  The  optimal  solution  value  z\  of  problem  (P2)  and  the  optimal  dual  variables 
y*,  a*,  r  =  1 ,N  can  be  found  in  0(E?Li  Tr(nr)](m  +  N)L  +  M(m  +  N)(m  +  N)L ) 
arithmetic  operations. 

2.3  Cost  Splitting 

We  now  consider  LPs,  in  which  the  feasible  region  is  the  intersection  of  K  polyhedra. 
Examples  in  this  category  are  the  /f-matroid  and  if-polymatroid  intersection  problems, 
LP  relaxation  problems  of  combinatorial  problems  with  this  property,  etc.  In  order  to 
speed  up  algorithms  for  the  solution  of  such  problems  we  combine  our  technique  with  cost 
splitting  or  Lagrangean  decomposition  (see  for  example  Nemhauser  and  Wolsey  [25],  p.333), 
a  method  which  has  been  applied  to  strengthen  the  bounds  given  by  Lagrangean  relaxation. 
Consider  the  LP 

(-P3)  Z3  =  Min  cx  (4) 

subject  to 

£  £  £>1  D  S2  n . . .  Sk  , 

where  Si  . . .  Sk  are  polyhedra,  over  which  we  can  optimize  easily.  We  rewrite  the  problem 
as  follows: 


(P3)  23  =  Min  cx  1 
subject  to 


(5) 


xi  —  x2  =  0 
X2-  —  0 


Xk- 1  —  *k  =  0 

xi  €  Si ,  X2  £  S2,  ...  ,xk£Sk- 
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Let  xk,  k  G  Jr  and  wk,  k  £  Rr  be  the  extreme  points  and  extreme  rays  of  Sr,  (r  = 
1,2  Applying  the  resolution  theorem  to  the  polyhedra  ST,  (r  =  1,2 , . . . ,  K)  we 

rewrite  (P3)  interms  of  x *  and  wk.  Taking  the  dual  of  (P3)  we  obtain 

(D3)  z 3  =  Max  ct\  +  (72  +  . . .  +  &K 

subject  to 


yx  1  +  <ti  <  cx\ ,  k  e  Ji, 

-yx 2  +  <r2  < 

0,  k  6  J2, 

-yxkK  +  o-K  < 

0,  k  e  Jk 

ywk  <  civ*, 

keRi, 

yw 2  <  0, 

k  e  p2- 

ywkK  <  0, 

G  Pat- 

In  order  to  apply  Vaidya’s  algorithm  to  (£>3)  we  should  be  able  to  solve  efficiently  the 
separation  problem,  which  in  this  case  decomposes  to  the  K  subproblems: 

(SEPi)  Min  (c  —  y)x\ 

subject  to 

*1  €  Si 

and  for  r  =  2, . . . ,  K 

( SEPr )  Min  yxr 

subject  to 

Xr  £  Sr  • 

As  a  result,  Vaidya’s  algorithm  applied  to  (£>3)  with  separation  problems  ( SEPr ),  r  = 
1,  •  •  ■ ,  K  computes  the  optimal  value  23  of  (-D3)  (which  is  also  equal  to  the  optimal  solution 
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value  of  (P3))  and  the  optimal  dual  solution  y*,  a*,  r  =  In  order  to  analyze 

the  running  time  of  the  algorithm  let  n  be  the  number  of  variables,  and  let  Tr(n)  be  the 
number  of  arithmetic  operations  to  solve  the  separation  problem  ( SEPr )  respectively.  From 
(2)  with  k  —  Kn  we  obtain: 

Theorem  3  The  optimal  solution  value  Z3  of  problem  (P3)  and  the  optimal  dual  variables 
y* ,  o-j,  02,...  a*K,  can  be  found  in  Tr(n)1  KnL  +  M(Kn)KnL)  arithmetic  oper¬ 

ations. 

The  cost  splitting  approach  will  be  superior  than  applying  Vaidya’s  method  directly  to  (P3) 
whenever  the  separation  problem  over  Sr  is  more  difficult  than  the  optimization  problem 
over  ST-  Examples  in  this  category  include  polymatroid  polytopes.  As  a  result,  we  will  see 
that  the  cost  splitting  approach  leads  to  significant  improvements  in  the  A'-polymatroid 
intersection  problem. 

2.4  Applications  to  Lagrangean  relaxation 

Lagrangean  relaxation  is  a  primary  method  used  in  practice  to  find  good  bounds  for  com¬ 
binatorial  optimization  problems.  Consider  the  integer  programming  problem: 

zip  —  Min  cx  (6) 

subject  to 

Ax  <  b 

x  €  S  =  {x  G  Z\  :  Axx  <  61}. 

Suppose  we  want  to  solve  the  Lagrangean  dual 

(-P4)  zpo  —  Max\> 0  Minxes  [cx  +  \(b  -  Ax)]. 

It  is  well  known  that  zpp  =  Min{cx  :  Ax  <  b,  x  £  conu(5)}  and  also  zpp  <  zpp)  <  zjp, 
i.e.,  the  Lagrangean  dual  gives  better  bounds  than  the  LP  relaxation  (see  for  example 
Nemhauser  and  Wolsey  [25],  p.  327)  . 
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In  order  to  find  z^p  we  rewrite  (P4)  as  follows: 

(-P4)  ZLD  =  Max  w 

w  <  cx  +  A(i  —  Ax)  for  all  x  €  5 
A  >  0. 

In  order  to  apply  Vaidya’s  algorithm  to  (P4)  we  need  to  solve  the  following  separation 
problem:  Given  (w,X),  with  A  >  0 

(SEP)  Max  (c  -  A A)x  (7) 

subject  to 

x  e  S. 

If  T(n)  is  the  number  of  arithmetic  operations  to  solve  the  separation  problem  (7)  and  there 
m  constraints  Ax  <  b,  then  the  application  of  Vaidya’s  algorithm  to  the  reformulation  (Pj) 
leads  to: 

Theorem  4  The  optimal  solution  value  of  the  Lagrangean  dual  zip  of  problem  (P4)  and 
the  optimal  Lagrange  multipliers  A*,  can  be  found  in  0(T(n)mL  +  M(m)mL)  arithmetic 
operations. 

2.5  Variable  relaxation 

We  will  now  consider  LPs  where  instead  of  complicating  constraints  we  have  complicating 
variables.  Our  goal  is  again  to  speed  up  the  computation.  Consider  the  LP 

( P5 )  Z5  —  Min  cx  +  dy  (8) 

subject  to 

Ax  +  By  >  b 
x  >  0,  y  >  0. 
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Suppose  that  the  problem  is  easy  to  solve  whenever  y  is  fixed.  Examples  in  this  category  are 
LP  relaxations  of  fixed  charge  network  design  problems.  We  write  problem  (P5)  as  follows: 

z5  =  Miny> 0  [dy  +  Minx:Ax>b-By,  x>o  cx] 

Taking  the  dual  in  the  inner  minimization  we  obtain: 

25  =  Miny> 0  [dy  +  MaxvA<c,ir> 0  *(b  -  By)] 

which  can  be  written  as  follows: 

25  =  Min  dy  +  a  (9) 

subject  to 

7r(6  —  By)  <  cr  for  all  7r  £  {7r  :  nA  <  c,  7r  >  0). 

We  will  solve  problem  (9)  using  Vaidya’s  algorithm.  Given  a  (y,  cr),  the  separation  problem 
is 

(SEP)  Max  7 r(6  -  By) 

subject  to 

ttA  <  c 
7T  >  0 

which  by  taking  the  dual  is  equivalent  to 

(SEP1)  Min  cx 


subject  to 


Ax  >  b  —  By 


x  >  0. 


If  in  the  original  problem  (P5)  x  £  R+  and  y  €  R+  and  T(n)  is  the  number  of  arithmetic 
operations  to  solve  the  separation  problem  (SEP')  we  obtain  from  (2)  that  Vaidya’s  algo¬ 
rithm  takes  0(T(n)mL+ M (m)mL) .  Note  that  in  this  case  the  algorithm  not  only  produces 
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the  optimal  solution  value,  but  in  addition  it  finds  the  optimal  y*.  Given  the  optimal  y*, 
we  can  solve  problem  (SEP')  in  T(n)  arithmetic  operations  to  find  the  optimal  solution  x* 
as  well.  Therefore,  in  this  case  we  can  derive  the  the  optimal  solution  value  as  well  as  the 
optimal  solution.  Therefore, 

Theorem  5  The  optimal  solution  value  z£  of  problem  (P5)  and  the  optimal  solution  x*,  y* 
can  be  found  in  0(T(n)mL  +  M(m)mL)  arithmetic  operations. 

2.6  Summary  of  algorithms 

In  this  section  we  summarize  our  findings  in  order  to  facilitate  the  reading  and  for  future 
reference.  In  table  I  we  summarize  the  problem  type  we  considered  and  the  separation 
algorithm  we  need  to  solve.  Table  II  includes  the  running  times.  T(n)  always  refers  to 
the  time  to  solve  the  separation  problem  in  table  I  and  M(n)  is  the  number  of  arithmetic 
operations  to  multiply  two  n  x  n  matrices. 


Table  I:  Problem  type  and  its  separation  problem 


Problem 

Separation  Problem 

(Pi)  Min  cx,  s.t.  Ax  —  b,  x  E  S 

Min  c'x,  s.t.  x  €  S 

(Pf)  Min  Y^=i  cr%r,  si.  X^Li  Arxr  =  b,  xr  E  Sr 

Min  c'rxT ,  s.t.  xT  £  Sr 

(P3)  Min  cx,  s.t.  x  E  Si  fl  S2  •  •  •  fl  Sk 

Min  c'x,  s.t.  x  E  Sr 

( P4 )  Max a>0  MinX£S[cx  +  \(b  -  Ax)] 

Min  c'x,  s.t.  x  E  S 

(P5)  Min  cx  +  dy,  s.t.  Ax  +  By  >  b,  x,y  >  0 

Min  c'x,  s.t.  Ax  >  b  —  By,  x  >  0 

Table  II:  Running  times 

Problem 

Running  time 

(Pi)  Min  cx,  s.t.  Ax  =  b,  x  E  S 

0(T(n)mL  +  M(m)mL) 

(P2)  Min  1  crXr,  s.t.  Y^Li  Arxr  =  b,  xT  E  ST 

0([(E?=i  Tr(nr))  +  M(m  +  N)](m  +  N)L) 

(P3)  Min  cx,  s.t.  x  €  Si  fl  £>2  •  -  -  fl  Sk 

0(( Ef=i  Tr(n))KnL  +  M(Kn)KnL) 

(P4)  Max a>o  MinX£s[cx  +  A(6  —  Ax)] 

0(T(n)mL  +  M(m)mL) 

(P5)  Min  cx  +  dy,  s.t.  Ax  +  By  >  b,  x,  y  >  0 

0(T(n)mL  +  M(m)mL) 
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3  Applications 

In  this  section  we  apply  the  theorems  of  the  previous  sections  to  solve  LP  and  Lagrangean 
relaxations  of  several  classical  combinatorial  optimization  problems.  Our  intention  is  not  to 
exhaust  all  the  possible  applications  of  our  methods.  It  is  rather  to  illustrate  the  significant 
computational  savings  that  can  result  from  our  approach  to  some  of  the  classical  problems  in 
combinatorial  optimization.  We  start  our  investigation  with  the  traveling  salesman  problem 
(TSP): 

3.1  The  Held  and  Karp  lower  bound  for  the  TSP 

Held  and  Karp  [16]  proposed  a  Lagrangian  relaxation  based  on  the  notion  of  1-tree  for 
the  TSP.  Using  a  complete  characterization  of  the  1-tree  polytope,  they  showed  that  this 
Lagrangian  relaxation  gives  the  same  bound  as  the  LP  relaxation  of  the  following  classical 
formulation  of  the  TSP: 

Min  Y  Y  c*jx*j  (10) 

ieV  jeV,j>i 

subject  to 


E  xu+  E  *;«•  = 2 

jevj>»  jev,j<i 

Vie  v 

(ii) 

E  E  x*i  —  I'-’i  —  i 

«€-S  j€S,j>i 

(12) 

i-H 

VI 

VI 

o 

€  V,j  >  i 

(13) 

xn  e  {o,  1} 

Vi,  j  ev,j  >  i 

(14) 

In  the  above  formulation  a :,-j  indicates  whether  cities  i  and  j  are  adjacent  in  the  optimal 
tour;  Cij  represents  the  cost  of  traveling  from  city  i  to  city  j  or,  by  symmetry,  from  city  j 
to  city  i.  One  can  compute  the  Held-Karp  lower  bound  ZfjK  in  polynomial  time  using  the 
Ellipsoid  or  Vaidya’s  algorithm  directly,  since  the  separation  problem  corresponding  to  the 
polytope  (11)-(13)  reduces  to  a  max-flow  problem.  Using  this  approach  Vaidya’s  algorithm, 
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which  is  the  fastest  of  the  two,  will  take  0(n3n2  L  + M(n2)n2  L)  arithmetic  operations,  since 
from  (2)  there  are  k  =  n2  variables  and  T(n)  —  0(n3)  is  the  time  to  solve  a  max-flow 
problem  on  a  possibly  complete  graph.  Thus  this  approach  takes  0(n6  76L)  where  we  used 
the  bound  that  M(k)  =  0(k238).  Note  that  the  ellipsoid  algorithm  will  be  even  worse 
taking  0(n8L). 

The  HK  polytope  (1 1)-(13)  is  exactly  in  the  form  of  problem  (Pi),  where  S  is  the  span¬ 
ning  tree  polytope  described  by  the  constraints  (12),  (13).  Applying  theorem  1  we  obtain 
that  using  our  approach  we  can  compute  zhk  in  0(n2nL  +  M(n)nL )  =  0(n33SL)  arith¬ 
metic  operations,  since  the  separation  problem  is  a  minimum  spanning  tree  computation, 
i.e. ,  T(n)  =  0(n2)  and  the  number  of  extra  constraints  is  m  =  n.  As  a  result,  our  approach 
leads  to  the  fastest  known  algorithm  for  HK.  Moreover,  if  one  does  not  use  fast  matrix 
multiplication  (i.e.,  M[k )  =  k3),  then  our  approach  leads  to  0(n4L)  time  complexity  while 
Vaidya’s  or  the  Ellipsoid  method  take  0(n8L),  a  savings  of  0(n4). 

3.2  The  Steiner  tree  and  the  k-connected  problem 

Goemans  and  Bertsimas  [13]  prove  that  under  the  triangle  inequality,  the  cost  of  the  LP 
relaxation  of  the  Steiner  tree  problem  zateiner  and  the  fc-connected  problem  Zk-conn  are 
related  in  the  following  way 

1  k 

Z Steiner  —  ^  %HK  >  Zk—conn  —  ^  % HK  > 

where  zhk  is  the  cost  of  the  Held-Karp  lower  bound  for  the  TSP.  Therefore,  if  the  cost 
satisfy  the  triangle  inequality,  we  can  apply  the  algorithm  of  the  previous  subsection  to 
compute  the  value  of  the  LP  relaxation  of  the  Steiner  tree  problem  and  the  ^-connected 
problem. 

3.3  The  vehicle  routing  problem 

Consider  the  following  classical  vehicle  routing  problem:  There  is  a  set  A  of  K  vehicles, 
located  at  a  single  depot  0,  such  that  the  fcth  vehicle  has  capacity  Qk  and  is  allowed  to 
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travel  a  distance  of  at  most  <4.  These  vehicles  serve  a  set  V  of  n  customers.  Customer  i 
has  demand  pi ,  while  c k-  is  the  cost  of  vehicle  k  traveling  from  i  to  j  and  d{j  is  the  distance 
from  i  to  j.  The  goal  is  to  route  the  vehicles  at  minimum  cost  such  that  all  constraints  are 
satisfied.  We  formulate  the  problem  as  follows: 

Let  be  1  if  vehicle  k  travels  from  i  to  j  and  0  otherwise.  Let  Sk  be  the  following  polytope 


s*  =  <4l£  £  4<isi-!vmscv,  £4,  +  =  2}. 

»€S  jes,j>i  igv  jev 

The  polytope  Sk  is  the  intersection  of  the  spanning  tree  polytope  on  V  (note  that  V  does 
not  include  the  depot  0)  and  and  an  additional  constraint  that  2  additional  arcs  are  incident 
to  the  depot.  For  fixed  k  we  denote  all  the  4’s  as  the  vector  xk .  We  are  interested  to 
compute  the  LP  relaxation  of  the  following  formulation  of  VRP: 


(VRP)  Min  ^£44 

i,j,k 

(15) 

subject  to 

EE4  =  1 

iev  keA 

(16) 

££4  =  i  vi^o 

j£V  k£A 

(17) 

£  x^dn  <dk  'ike  a 
ijev 

(18) 

E  xijP*  <Qk  ike  a 

i,j€V 

(19) 

xk  €  Sk 

(20) 

0  <  4  <  1 

(21) 

4  6  {0, 1} 

(22) 
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In  order  to  solve  the  LP  relaxation  of  the  above  problem  we  will  apply  our  approach  of 
section  2.2.  The  above  formulation  is  of  the  type  of  problems  ( P2 ),  where  there  are  N  =  K 
subproblems  Sk,  and  the  number  of  additional  constraints  (16)-(19)  is  m  =  2(n  +  K). 
Since  we  can  optimize  over  Sk  using  the  greedy  algorithm,  the  time  to  solve  the  separation 
problem  is  0(n2).  Thus,  applying  theorem  2,  we  can  solve  the  LP  relaxation  of  ( VRP )  in 
0(Kn2(n  + I<)L  + M(n  + K)(n  + K)L)  -  0((n3K  +  n338)L),  since  we  can  assume  K  <  n. 

For  comparison  if  we  applied  Vaidya’s  algorithm  directly  to  (15)  it  would  lead  to  an 
0(Kn3(Kn2)L  +  M(Kn2)(Kn2)L)=0(K3-38n6-76L)  algorithm,  since  there  are  Kn2  vari¬ 
ables  and  the  separation  problem  reduces  to  K  max-flow  problems. 

3.4  Multicommodity  flows 

Consider  the  classical  multicommodity  flow  problem:  Given  a  network  G  =  (V,E)  ( | |  = 
n,  IE1!  =  m),  a  set  C  of  K  commodities  and  a  supply  (or  demand)  b *  of  commodity  k  at 
node  i  £  V .  Arc  (t,  j )  has  capacity  and  the  cost  of  sending  one  unit  of  flow  of  commodity 
k  across  arc  (i,j)  is  c^.  The  goal  is  to  decide  the  amount  of  flow  from  commodity  k  to 
send  across  arc  so  as  to  satisfy  supply-demand  and  capacity  constraints  at  minimum 

cost.  The  classical  formulation  of  the  problem  is: 


Min  cijxij 

(23) 

bjev,  fcec 

subject  to 

£4<u*i 

(24) 

E4--E4  =  ‘‘  icv.kec 

(25) 

jev  jev 

H 

IV 

0 

(26) 

The  above  formulation  is  of  the  type  (P2)  in  section  2.2,  with 

sk  =  Hi  4  >  0.  E  4  -  £  4  =  bi  *'  e  n 

jev  jev 
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and  with  m  global  constraints  (24).  In  this  case  the  separation  problem  is  a  min-cost  flow 
problem.  Under  the  similarity  assumption,  the  time  to  solve  the  separation  problem  is 
T  =  0(nmlog2n).  For  a  more  refined  definition  of  T  see,  for  example,  Ahuja  et.  al.  [1]. 

As  a  result,  applying  theorem  2  we  can  solve  the  multicommodity  flow  problem  in 

0([Kmnlog2n  +  M{m  +  K)](m  +  K)L)  —  0([Knm2log2n  +  m3-38]i). 

The  comparison  for  multicomodity  flows  is  more  complex  because  of  another  algorithm 
of  Vaidya  [28].  He  considered  the  problem  in  which  each  commodity  consists  of  a  sin¬ 
gle  source  and  a  single  sink.  The  resulting  running  time  is  0(K25n2y/mL).  This  run¬ 
ning  time  dominates  ours  in  some  cases  and  is  dominated  by  ours  in  others.  For  exam¬ 
ple,  for  K  =  n2  Vaidya’s  running  time  is  0(n7 y/rnL).  However,  our  algorithm  runs  in 
0([n2m2Iog2n  +  m3-38]i)  time  in  this  case,  since  the  problem  can  be  converted  into  a  n- 
commodity  flow  problem.  In  this  case,  our  algorithm  dominates  Vaidya’s  for  all  values  of 
m,  and  is  increasingly  better  as  the  graph  becomes  sparser. 

3.5  Network  flows  with  side  constraints 

Typical  problems  met  in  practice  involve  network  flow  problems  with  some  additional  side 
constraints.  Consider  for  example  a  min-cost  flow  problem  with  K  additional  constraints. 
Using  these  K  constraints  as  the  global  constraints  in  the  formulation  of  problem  (Pi)  in 
section  2.1  and  the  network  flow  polytope 

{x,j|  X{j  >  0,  Xij  —  Xji  —  i  G  V} 

j€V  j£V 

as  the  polytope  S  we  can  apply  theorem  1  to  solve  the  problem  in  O([mnlog2n+ M(K)]K L), 
where  T  =  mnlog2n  is  an  upper  bound  on  the  complexity  to  solve  the  network  flow  problem 
under  the  similarity  assumption  (see  [1]).  For  I<  constant  we  see  that  the  complexity  of 
solving  the  problem  with  K  side  constraints  is  exactly  the  same  as  the  complexity  of  solving 
the  problem  with  only  one  side  constraint,  i.e.,  0{{mnlog2 n)L). 

If  one  applied  an  interior  point  algorithm  for  this  problem,  it  would  lead  to  an  0(m3L ) 
running  time. 
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3.6  The  network  design  problem 

The  fixed  charge  network  design  problem,  which  is  a  fundamental  discrete  choice  design 
problem,  is  useful  for  a  variety  of  applications  in  transportation,  distribution,  communica¬ 
tion,  and  several  other  problem  settings  that  make  basic  cost  tradeoffs  between  operating 
costs  and  fixed  costs  for  providing  network  facilities  (see  Magnanti  and  Wong  [24]).  The 
problem  is  described  as  follows.  We  are  given  a  set  of  nodes  N ,  a  set  of  uncapacitated  arcs 
A  and  a  set  K  of  commodities.  For  each  k  E  K,  one  unit  of  flow  of  commodity  k  must  be 
sent  from  its  origin  0(k)  to  its  destination  D(k).  Each  arc  has  two  types  of  cost:  a  per  unit 
flow  cost  depending  on  the  commodity  and  a  fixed  charge  for  using  the  arc.  The  problem 
is  to  select  a  subset  of  arcs  that  minimizes  the  sum  of  the  routing  costs  and  fixed  charge 
costs. 

The  importance  of  the  network  design  problem  stems  from  its  wide  applicability  and 
flexibility.  As  noted  in  Magnanti  and  Wong  [24],  it  contains  a  number  of  well-known  network 
optimization  problems  as  special  cases  including  the  shortest  path,  minimum  spanning  tree, 
uncapacitated  plant  location,  traveling  salesman  and  Steiner  tree  problems. 

There  are  a  number  of  IP  formulations  for  the  problem.  For  a  review,  see  Magnanti  and 
Wong  [24].  Balakrishnan  et  al.  [3]  propose  the  following  multicommodity  flow  formulation, 
which  contains  two  types  of  variables,  one  modeling  discrete  design  choices  and  the  other 
continuous  flow  decisions.  Let  y;j  be  a  binary  variable  that  indicates  whether  (y,y  =  1)  or 
not  (yij  =  0)  arc  {i,  j}  is  chosen  as  part  of  the  network’s  design.  Let  x\-  denote  the  flow  of 
commodity  k  on  the  directed  arc  {i,j).  Note  that  ( i,j )  and  {j,i)  denote  directed  arcs  with 
opposite  orientations  corresponding  to  the  undirected  arc  {i,  j}.  Even  though  arcs  in  the 
formulation  are  undirected,  we  refer  to  the  directed  arcs  (i,j)  and  (j,  i)  because  the  flows 
are  directed.  The  formulation  is  the  following. 


Min 


subject  to 


(27) 
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-1  i  =  0(k) 

S  xii~  X)  X*'i  =  *  1  *  =  D(fc)  (28) 

i€V:(j,<)€i4  i£V:(i,j)eA 

U  otherwise 

(DPi)  xfj  <  yij ,  4<y,i  {i,i}G  A,  ia  (29) 

X"  >  0  {i,j}eA,keK 

y.j  e  {o,  1}  (*',  j)  e  A. 

In  this  formulation  each  arc  {i,  j)  has  a  nonnegative  fixed  design  cost  Fii  and  c%j  is 
the  nonnegative  cost  for  routing  commodity  k  on  the  directed  arc  ( i,j ).  Constraints  (28) 
imposed  upon  each  commodity  k  are  the  usual  network  flow  conservation  equations.  The 
“forcing”  constraints  (29)  state  that  if  yij  =  0,  i.e.,  arc  {i,j}  is  not  included  in  the  design, 
then  the  flow  of  every  commodity  k  on  this  arc  must  be  zero  in  both  directions,  and  if  arc 
{i,y}  is  included  in  the  design,  i.e.,  y,j  =  1  ,  the  arc  flow  is  unlimited.  Directed  network 
design  problems  are  formulated  in  a  very  similar  manner. 

Although  the  network  design  problem  is  a  hard  discrete  optimization  problem,  in  the  last 
decade  researchers  have  proposed  several  computationally  successful  approaches  for  solving 
it.  Magnanti  et  al.  [22]  propose  a  Benders  decomposition  approach,  and  Balakrishnan  et  al. 
[3]  propose  a  dual  ascent  heuristic  which  has  solved  large  instances  of  network  design  prob¬ 
lems  to  within  2%-5%  of  optimality.  In  both  these  cases  the  authors  judge  the  algorithm’s 
effectiveness  by  comparing  solutions  generated  to  the  LP  relaxation  of  their  formulations. 
It  is  therefore  important  to  solve  the  LP  relaxation  efficiently. 

We  treat  the  forcing  variables  yij  in  the  network  design  formulation  (27)  as  the  compli¬ 
cating  variables  in  the  sense  of  section  2.5.  If  the  y,y  are  known  then  the  problem  decomposes 
to  K  shortest  paths  problems.  Therefore,  applying  theorem  5,  the  LP  relaxation  of  (27) 
can  be  solved  in 

0([K(m  +  nlogn )  +  M(m)]ml), 

where  m  is  the  number  of  complicating  variables  y,y ,  and  0(m  +  nlogn)  is  the  time  to  solve 
a  single  shortest  path  problem.  Note  that  for  the  problems  considered  in  [3]  K  =  n2  and 
m  =  O(n)  and  thus  our  algorithm  takes  0([n2(m  +  nlogn)]mL). 
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For  purposes  of  comparison  if  one  solves  the  LP  relaxation  of  (27)  using  an  interior  point 
algorithm,  it  will  lead  to  an  0(/f3m3L)  running  time. 

3.7  Facility  location  problems 

We  consider  the  well  known  p-median  problem  in  facility  location  (see  for  example  [25]). 
We  are  interested  in  solving  the  LP  relaxation  of  the  following  formulation  of  the  problem: 


Min  E  cijxij  +  E  W  (30) 

iev  jev 

subject  to 

E  «  =  p  (31) 

j€V 

E  *«  =  1  *  e  K  (32) 

j€V 

xij  <Vj  L  3  e  V  (33) 

xn  >  0,  0  <  yj  <  1  (34) 

we  {0,1}  (35) 


The  interpretation  is  that  yj  is  1  if  node  j  is  assigned  to  a  facility  and  0  otherwise  and  x,j 
is  1  if  node  i  is  assigned  to  a  facility  j  and  0  otherwise.  The  LP  relaxation  of  (30)  has  been 
found  to  be  very  close  to  the  IP  solution.  For  this  reason  almost  all  algorithmic  approaches 
to  the  problem  compute  first  the  LP  relaxation. 

In  order  to  solve  the  LP  relaxation  we  observe  that  the  p-median  problem  is  of  the  type 
of  problem  (Pi)  with  constraints  (31)  and  (32)  being  the  global  constraints  and  (33)  and 
(34)  being  the  polytope  S.  We  can  solve  the  separation  problem  over  5  in  T(n)  =  0(n 2) 
(| V\  =  n),  since  we  can  solve  it  in  closed  form  in  one  pass.  Therefore,  applying  theorem  1  we 
can  solve  the  LP  relaxation  of  the  p-median  problem  in  0(n2nL  +  M(n)nL)  =  0(n3-38L). 
For  comparison  purposes,  if  one  applied  an  interior  point  algorithm  directly  to  solve  the  LP 
relaxation  of  (30),  it  would  take  0(neL)  iterations  since  there  are  0(n2)  variables. 

For  uncapacitated  location  problems  (see  for  example  [25])  exactly  the  same  approach 
as  in  the  case  of  the  p-median  problem  leads  to  an  0(n3'38L)  algorithm  for  the  solution  of 
the  LP  relaxation. 
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3.8  The  K-polymatroid  intersection  problem 

Consider  K  polymatroids  M;  =  ( N ,  fi)  where  fi  is  a  submodular  set  function.  For  example, 
if  fi  is  the  rank  function  of  a  matroid,  the  problem  reduces  to  the  Zf-matroid  intersection 
problem.  Given  costs  cj  for  all  j  6  N,  the  weighted  Zf-polymatroid  intersection  problem  is 
described  by  the  mathematical  programming  problem: 

Max  CjXj  (36) 

j€N 

subject  to 

</i(5)  vscn  (37) 

ies 

E  xi  <  MS)  VS  C  N  (38) 

ies 

Xj  >  0 

Classical  problems  in  combinatorial  optimization  can  be  modelled  in  that  way.  For  example 
the  maximum  spanning  tree  (K  =  1  and  fi(S)  =  |5|  —  1,  maximum  bipartite  matching 
(K  =  2  and  /,(5)  are  the  rank  functions  of  two  partitioned  matroids).  Our  goal  is  to  solve 
(36)  using  the  techniques  of  section  2.3. 

Let  Si  =  {x  >  0|  J2jeS  xj  S  fi(S)  VS  C  N}.  Using  the  cost  splitting  method  of  section 
2.3  and  applying  theorem  3  we  can  solve  problem  (36)  in  0([I<T(n)  +  M(Kn)\KnL),  where 
T(n)  is  the  number  of  arithmetic  operations  to  solve  the  optimization  problem  over  one 
polymatroid,  which,  as  it  is  well  known  (see  for  example  Nemhauser  and  Wolsey  [25], 
p.689),  can  be  solved  by  the  greedy  algorithm  as  follows: 

1.  Sort  Cl  >  C2  >  ...  >  Cfc  >  0  >  ck+ 1  >  ...  >  Cn  • 

2.  Let  Si  =  {1, . . . ,  j}  with  5°  =  0. 

3.  xj  =  f(Si)  —  /(Si-1)  for  j  <  k  and  xj  =  0  for  j  >  k. 
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For  purposes  of  comparison,  an  alternative  approach  is  to  apply  Vaidya’s  algorithm  to 
(36)  directly.  The  separation  problem  is  to  decide  whether  a  given  xq  E  Si-  Such  an  ap¬ 
proach  leads  to  a  0([K A(n)  ■+■  M (n)]nL)  arithmetic  operations  where  A(n)  is  the  number  of 
arithmetic  operations  to  solve  the  separation  problem  xo  E  Si-  Indeed,  A(n)  =  0(nL[T(n)+ 
M(n)])  if  we  use  Vaidya’s  algorithm.  Overall  this  approach  leads  to  0(K(nL)2[T(n )  + 
M(n)])  arithmetic  operations.  Alternatively  in  order  to  solve  the  separation  problem,  one 
could  use  the  strongly  polynomial  algorithm  of  Cunningham  [9],  but  unfortunately  the 
running  time  would  not  be  as  good. 

Overall,  we  expect  that  our  approach  will  work  better,  in  problems  in  which  the  sepa¬ 
ration  problem  is  much  harder  than  the  optimization  problem. 

3.9  Network  flow  problems  on  graphs  with  almost  special  structure 

Consider  a  network  flow  problem  on  the  network  G  =  ( N ,  AUJ5)  such  that  Ga  —  {N,  A)  is 
a  graph  of  special  structure  (for  example  planar,  tree,  unbalanced  bipartite,  etc.)  for  which 
the  related  network  flow  problem  can  be  solved  faster  than  in  a  general  graph.  For  example, 


for  network  flow  problems  on  unbalanced  bipartite  graphs  see  [2],  Assume  that  |B|  =  K. 
The  network  flow  problem  can  be  formulated  as  follows: 

z  =  Min  cAxA  +  cBxB  (39) 

subject  to 

Naxa  +  Nbxb  =  b  (40) 

0  <xA  <uA  (41) 

0  <xB<uB  (42) 


where  Na,  Nb  is  the  arc  incidence  matrix  corresponding  to  the  arcs  in  A  and  in  B  respec¬ 
tively. 

We  first  observe  that  problem  (39)  is  of  the  type  of  problem  (P5)  in  section  2.5.  Applying 
the  variable  splitting  algorithm  of  section  2.5,  we  obtain  that  problem  (39)  can  be  solved 
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in  0([TA{n,m)  +  M(K)]KL )  where  TA{n  ,  m)  is  the  time  to  solve  the  network  flow  problem 
on  GA  =  ( N,A ),  which  is  a  graph  of  special  structure.  Because  of  the  special  structure  of 
G A,  TA(n,  m)  will  be  smaller  than  the  time  to  solve  the  problem  on  general  graphs.  For  K 
constant  the  running  time  becomes  0{TA(n,  m)L).  For  comparison  purposes  we  will  denote 
the  running  time  on  general  graphs  as  0(Ta{n,  m)). 

3.10  The  multiple  item  capacitated  lot  sizing  problem 

Consider  the  multiple  item  capacitated  lot  sizing  problem,  where  Xjt,yjt  and  Sjt  represent 
the  production,  setup  and  storage  variables  for  item  j  in  period  t,  djt,Cjt,  fjt,  hjt  are  the 
demand,  production  cost,  setup  cost  and  storage  cost  for  item  j  in  period  t  and  Qt  represents 


the  amount  of  the  resource  available  in  period  t: 

K  T 

Min  Y^52 bit xjt  +  fjt yjt  +  hjt sjt]  (43) 

j- 1 t= l 

subject  to 

xjt  +  sj,t- 1  =  djt  +  sjt  j  =  1, . . .  K,  t  =  1, . . .  T  (44) 

Sjo  =  SjT  =  0  j  =  1, . . .  K  (45) 

T 

xjt  <  djr)Vjt  j  =  l,...  I<,  t  =  l,...T  (46) 

r=t 

K 

52  Xjt  <  Qt  t  =  1 , . . .  T  (47) 

j=i 

Xjt,  sjt  >0  yjt  E  {0, 1},  (4g) 


The  multiple  item  capacitated  lot  sizing  problem  is  ATP-hard.  If  we  relax  constraints  (47) 
the  problem  decomposes  into  K  single  item  capacitated  lot  sizing  problems,  each  of  which 
can  be  solved  by  a  dynamic  programming  algorithm,  that  has  0(T)  running  time.  Applying 
the  algorithm  of  section  2.4  we  can  find  the  value  of  the  Lagrangean  dual  in 

0([I<T  +  M(T))TL)  =  0([I<T 2  +  T3-38]!). 
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Note  that  the  value  of  the  Lagrangean  dual  can  be  strictly  better  that  the  value  of  the 
LP  relaxation,  since  the  subproblem  does  not  have  the  integrality  property.  To  the  best  of 
our  knowledge  we  do  not  know  any  other  polynomial  time  approach  for  the  problem.  For 
comparison,  the  solution  of  the  LP  relaxation  of  (43),  which  gives  a  weaker  bound  than  the 
Lagrangean  dual,  takes  0(K3T3  L)  using  an  interior  point  approach. 

3.11  Comparisons  with  the  previously  known  fastest  method 

In  order  to  facilitate  the  comparison  of  our  methods  with  the  previously  fastest  known 
methods  we  include  table  III.  We  assumed  that  we  could  use  fast  matrix  multiplication. 
The  problems  refer  to  the  LP  relaxation  or  the  Lagrangean  dual. 


Table  III:  Comparisons 


Problem 

Our  running  time 

Best  previuosly  known 

Held-Karp 

0(n338L) 

0(n6-76L) 

Steiner  tree,  fc-connected 

0(n3,3SL) 

0(n6-76L) 

if-vehicle  routing 

0{[n3-3S  +  n3K]L) 

0(K33Sn6-76L) 

/^-multicommodity  flow 

0([Knm2log2n  +  m3'38]L) 

0{K25n2s/mL) 

Network  flows  with  constraints 

0([Knmlog2n  +  if3-38]/,) 

0{m3L) 

Network  design 

0([K(m  +  nlogn)  +  m2  38]mL ) 

0(K3m3L ) 

Facility  location  problems 

Q(n3-38L) 

0{n6L) 

/f-polymatroid  intersection 

0([KT{n)  +  M{Kn))KnL) 

0(I<(nL)2[T(n)  +  M(n)]) 

Network  flows  on  G(V,  A  U  jB) 

0(TA(n,m)L ) 

0{TG(n,m )) 

capacitated  lot  sizing 

0{[I<T2  +  T3-38]!) 

? 

4  Concluding  remarks 


The  previous  section  was  simply  an  indication  of  the  variety  of  different  applications  our 
method  has  in  combinatorial  optimization.  One  can  certainly  find  other  applications  in  other 
areas  of  combinatorial  optimization  (for  example  scheduling  and  sequencing).  Our  technique 
can  also  be  used  to  solve  stronger  Lagrangean  duals  using  Lagrangean  decomposition. 
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Although  our  techniques  lead  to  the  fastest  known  algorithms  for  several  problems  from 
a  worst-case  perspective  by  a  significant  margin,  we  are  not  certain  whether  our  techniques 
can  be  competive  from  a  practical  standpoint  with  the  classical  methods  to  solve  the  La- 
grangean  dual,  like  subgradient  optimization.  The  practicality  of  our  algorithm  critically 
depends  on  whether  Vaidya’s  algorithm  is  a  practical  algorithm,  and  to  our  knowledge 
Vaidya’s  algorithm  has  not  been  tested  in  practice.  We  believe,  however,  that  perhaphs  a 
combination  of  our  techniques  with  the  classical  methods  to  solve  the  Lagrangean  dual  can 
potentially  lead  to  practical  algorithms  as  well. 
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